How We Make Sense of Social Interactions
“I like to watch people. Sometimes I ride the subway all day and look at them and listen to them. I just want to figure out who they are and what they want and where they’re going.”
— Ray Bradbury, Fahrenheit 451
People-watching is central to our social existence
Traditional Research
New Research Direction
What clues do we use when people-watching? Let’s see how many you can identify!
Three brain networks work together:
Companies like Coca-Cola use our people-watching instincts in advertisements:
As I show each image, write down:
When we’re accurate:
When we make mistakes:
Did social complexity drive brain evolution?
Clinical Psychology
Education
Technology
How can you become a better people-watcher?
Exciting new directions:
People-watching is more than entertainment:
Mini-experiment for the next week:
Questions to consider:
How do researchers systematically study something as complex and natural as people-watching?
Traditional Approach
TPE Approach
Researchers use a variety of stimuli to study people-watching:
Static
Dynamic
Abstracted
How they work: * Actors wear reflective markers on joints * Movements are recorded in darkness * Only points of light are visible * Removes all identity cues * Isolates pure motion information
The surprising finding: We can determine social relationships from just moving dots!
What researchers track: * Fixation patterns between interacting people * Gaze switches between interaction partners * Time spent looking at different body parts * Pupil dilation (indicating emotional response) * Scan path analysis (the sequence of looking)
fMRI Studies Reveal:
The Three Networks:
Encounter Categorization Task
Encounter Prediction Task
How it works: * Observers view brief (10-30 second) clips of interactions * Make judgments about relationships, traits, or outcomes * Judgments are compared to actual outcomes or self-reports * Measures the accuracy of rapid social perception
Key research question: How much social information can we extract from minimal exposure?
Researchers isolate and manipulate specific visual cues:
Physical proximity
Facial expressions
Body orientation
Motion synchrony
Methodology: 1. Filmed dyads of strangers having conversations 2. Participants rated their own felt rapport 3. Observers watched silent video clips 4. Observers rated perceived rapport 5. Compared self-reports vs. observer judgments 6. Analyzed which visual cues predicted each
Key finding: Observers relied on smiles, but participants’ ratings were linked to physical proximity
Research Questions: * Are some social perceptions universal? * How do cultural norms affect interpretation? * Which cues are culturally specific? * Can people accurately read interactions from other cultures?
Methodology: * Show identical interactions to people from different cultures * Compare perception accuracy across cultures * Analyze culture-specific interpretation biases * Test for universal vs. culture-specific cues
How do we process social interactions?
Feature-Based Processing * Extract specific visual components * Analyze individual cues (e.g., number of smiles) * Process components separately * Build up interpretation from parts
Template-Based Processing * Compare to stored patterns of typical interactions * Process interactions holistically * Use prior expectations to guide perception * Recognize patterns from minimal information
With Infants & Toddlers: * Looking time paradigms * Violation-of-expectation method * Preferential looking tasks * Action imitation studies * Measures: gaze duration, surprise, preference
Research Findings: * 6-month-olds notice “irrational” interactions * 12-month-olds have expectations about social goals * 18-month-olds imitate observed interactions * Social perception develops before language
Comparative Studies: * Compare clinical vs. typical populations * Diagnose social-cognitive differences * Identify specific processing differences * Design targeted interventions
Example: Autism studies show differences in: * Eye movement patterns * Neural activation patterns * Types of social cues utilized
Advantages: * Precise control over social scenarios * Manipulation of specific social variables * Immersive, ecological validity * Replicable across participants * Can track behavior in realistic contexts
Growing area of TPE research!
How It Works: * Create computational models of social perception * Test which features are most diagnostic * Simulate different processing strategies * Compare model performance to human performance * Identify minimal features needed for accurate perception
Questions Addressed: * Which visual features are most informative? * How do we integrate different social cues? * How does prior knowledge influence perception?
You are a social psychologist studying how teens detect popularity based on observed interactions.
What would you include in your research design? * What stimuli would you use? * What measures would you employ? * What variables would you manipulate? * How would you assess accuracy? * What technologies would you incorporate?
Research Question: How do we detect cooperative vs. competitive relationships?
Multi-method Approach: 1. Eye-tracking (what cues we look at) 2. fMRI (neural processing differences) 3. Behavioral measures (accuracy & reaction time) 4. Computational modeling (processing strategies)
Key Takeaways: * People-watching research uses sophisticated methodologies * Multiple techniques provide complementary insights * The field combines psychology, neuroscience, and computer science * These methods reveal how we make sense of our social world * New technologies continue to advance our understanding
The Science of People-Watching | 2025